Bayesian Elastic-Net and Fused Lasso for Semiparametric Structural Equation Models
نویسندگان
چکیده
SUMMARY: Structural equation models are well-developed statistical tools for multivariate data with latent variables. Recently, much attention has been given to developing structural equation models that account for nonlinear relationships between the endogenous latent variables, the covariates, and the exogenous latent variables. [Guo et al. (2012)], developed a semiparametric structural equation model where the nonlinear functional relationships are approximated using basis expansions and used Bayesian Lasso for simulations analysis and model selection. In this paper we consider semiparametric structural equation models when cubic splines are used for the basis expansion. Cubic splines are known to induce correlations. Bayesian fused Lasso and Bayesian elastic-net are used to account for correlations in both the covariates and basis expansions. We illustrate the usefulness of our proposed methods through a simulation study. The semiparametric structural equation models based on Bayesian fused Lasso and Bayesian elastic-net outperform the Bayesian Lasso model.
منابع مشابه
Adaptive Elastic Net GMM Estimator with Many Invalid Moment Conditions: A Simultaneous Model and Moment Selection
This paper develops an adaptive elastic-net GMM estimator with many possibly invalid moment conditions. We allow for the number of structural parameters (p0) as well as the number of moment conditions increasing with the sample size (n). The new estimator conducts simultaneous model and moment selection. We estimate the structural parameters along with parameters associated with the invalid mom...
متن کاملSelf-adaptive Lasso and its Bayesian Estimation
In this paper, we proposed a self-adaptive lasso method for variable selection in regression problems. Unlike the popular lasso method, the proposed method introduces a specific tuning parameter for each regression coefficient. We modeled self-adaptive lasso in a Bayesian framework and developed an efficient Gibbs sampling algorithm to automatically select these tuning parameters and estimate t...
متن کاملForecasting Euro Area Macroeconomic Variables with Bayesian Adaptive Elastic Net
I use the adaptive elastic net in a Bayesian framework and test its forecasting performance against lasso, adaptive lasso and elastic net (all used in a Bayesian framework) in a series of simulations, as well as in an empirical exercise for macroeconomic Euro area data. The results suggest that elastic net is the best model among the four Bayesian methods considered. Adaptive lasso, on the othe...
متن کاملBayesian lasso for semiparametric structural equation models.
There has been great interest in developing nonlinear structural equation models and associated statistical inference procedures, including estimation and model selection methods. In this paper a general semiparametric structural equation model (SSEM) is developed in which the structural equation is composed of nonparametric functions of exogenous latent variables and fixed covariates on a set ...
متن کاملThe Multiple Bayesian Elastic Net
We propose the multiple Bayesian elastic net (abbreviated as MBEN), a new regularization and variable selection method. High dimensional and highly correlated data are commonplace. In such situations, maximum likelihood procedures typically fail—their estimates are unstable, and have large variance. To address this problem, a number of shrinkage methods have been proposed, including ridge regre...
متن کامل